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SUMMARY 


This  report  develops  statistical  reliability  test  plans  for  systems  which 
are  not  continuously  operating  such  a a  missiles,  bombs,  and  fuses.  The  test 
plans  are  Bayesian  in  the  sense  that  existing  test  data  may  be  used  to  reduce 
the  sample  sizes  required  for  subsequent  testing.  The  prior  probability 
density  function  of  reliability  is  based  upon  this  objective  existing  test 
da-ta  and  is  used  to  derive  expressions  for  both  producer's  and  consumer's 
posterior  risks.  Tables  are  provided  for  the  practicing  reliability  manager 
to  use  in  designing  subsequent  tests  to  meet  threshold  values  of  producer's 
and  consumer's  posterior  risks. 
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SECTION  1 


BACKGROUND  AND  INTRODUCTION 

Each  year  Che  Department  of  Defense  spends  about  one-sixth  of  its  budget 
on  the  research,  development,  testing  and  evaluation  of  new  weapon  systems. 

The  reliability  test  programs  associated  with  these  systems  are  structured 
sequentially  to  qualify  the  designs  functionally,  demonstrate  the  operational 
capabilities  of  the  systems  under  realistic  environmental  conditions,  and 
prevent  degradation  in  these  operational  capabilities  during  production  and 
deployment.  With  rapidly  rising  costs  and  increasing  complexities  of  hardware 
fabrication  and  testing,  tremendous  emphasis  is  being  placed  on  using  data 
from  one  test  program  to  complement  results  of  successive  tests,  thereby 
increasing  the  confidence  associated  with  test  conclusions.  In  this  way  the 
entire  test  program  is  viewed  in  a  single  thread  continuum  rather  than  as  a 
series  of  separately  conducted  and  reported  events.  Unfortunately,  with  the 
absence  of  an  established  scientific  method  for  combining  data  from  several 
test  programs,  past  attempts  to  Implement  this  approach  have  been  necessarily 
subjective  and  largely  discounted  as  "seat-of-the-panfs. ” 

Much  work  has  been  done  in  the  reliability  community  to  fill  this  void  for 

continuously  operating  systems  such  as  avionics,  communications,  electronics 

and  radar.  In  particular,  the  Inverted  gamma  probability  distribution  has 

been  derived  as  a  model  for  the  Mean-Tlme-Between-Fallure  (MTBF)  of  such 
. « 

systems  with  exponentially  distributed  failure  times.  Data  from  preliminary 
tests  may  validly  be  used  with  the  inverted  gamma  model  to  construct  a 
baseline  distribution  on  MTBF.  Data  from  successive  tests  may  then  be  used  to 


update  this  baseline.  The  confidence  in  estimating  the  system  MTBF  increases 
as  testing  progresses,  eventually  reaches  an  acceptable  level,  and  testing 
ceases.  This  highly  acclaimed  approach  is  now  complete  with  sets  of  tables 
available  for  the  practicing  reliability  manager  (Reference  1  ). 

In  this  report  a  similar  approach  is  developed  for  systems  which  are”  not 
continuously  operating,  such  as  missiles,  bombs,  and  fuses.  These  "one-shot” 
devices  have  moved  to  the  forefront  in  development  priorities  and  are  viewed 
as  a  primary  means  of  enhancing  the  effectiveness  of  our  weapon  systems.  For 
example,  air  combat  exercises  conducted  at  Nellis  AFB  in  the  late  1970's 
demonstrated  that  the  operational  effectiveness  of  the  F-15  aircraft  was 
severely  restricted  by  the  limitations  of  existing  air-to-air  missile  systems. 
The  $8  billion  Advanced  Medium  Range  Air  to  Air  Missile  (AMRAAM)  represents 
just  one  initiative  to  remove  these  limitations.  Phrases  like  "launch  and 
leave"  and  "multiple  kills  per  pass”  symbolize  the  resolve  to  improve  our 
combat  capability  through  the  design  of  more  effective  armament  packages.  The 
results  of  this  report  make  integrated  test  design  and  analysis  possible  for 
these  systems. 


SECTION  2 


PROBLEM  STATEMENT 

The  purpose  of  this  report  is  to  develop  Bayesian  reliability  test  plans 
for  one-shot  devices.  The  test  plans  will  be  Bayesian  in  the  sense  that 
relevant  data  from  previous  testing  is  to  be  used  in  attempt  to  reduce  the 
sample  size  required  in  subsequent  testing.  From  the  standpoint  of  the  user 
of  such  test  plans,  the  problem  may  be  stated  in  the  following  way. 

"I  need  a  test  to  demonstrate  the  reliability  of  a  one-shot  device  —  a 
device  with  a  go  or  no-go  function.  The  classic  one-shot  device  is  the  cherry 
bomb;  military  examples  include  missiles,  rocket  motors,  bombs  and  fuses. 

I  have  a  certain  reliability  requirement  and  maximum  allowable  values  for 
producer's  risk  a  and  consumer's  risk  B  (risk  is  undefined  at  this  point). 

Of  course 

0  <  a  <  1 

—  in  — 

0  <  3  <  1 

—  in  — 

where  the  subcript  m  denotes  the  maximum  allowable  values  of  a  and  3.  I  have 
some  test  data  from  past  tests  which  may  be  summarized  as  N{  bemoulli  trials 
and  k^  failures,  and  would  like  to  use  this  data  to  reduce  further  testing. 

How  many  additional  trials  N2  are  required,  and  how  many  failures  k2  are 
allowed  (k2  ^  M)  to  do  this?" 

The  answer  to  the  problem,  then,  will  be  the  number  of  trials  required  (N2> 

and  the  maximum  number  of  failures  allowed  (M)  for  an  accept  decision  after  the 

test  is  complete.  The  pair  (N2,  M)  should  satisfy  the  constraints 

0  <  a  <  a 
“  —  tn 

0  <  3  <  3 

~  in 

given  the  previous  test  result  -  Nj  trials  and  k^  failures. 


SECTION  3 


RISK  DEFINITION 

Notice  that  the  problem  statement  in  Section  2  addresses  maximum  values 
of  producer's  and  consumer's  risks,  but  that  producer's  and  consumer's  risks 
were  not  defined.  Some  of  the  more  popular  choices  for  risk  definition  are 
shown  in  Table  1.  The  classical  risk  definitions  are  eliminated  since  the 
probability  statements  are  conditioned  on  a  single  value  of  r.  In  this  way 
the  prior  data  are  not  applicable  and  neither  is  the  Bayesian  approach.  The 
average  risks  are  a  version  of  classical  risks  with  values  "averaged”  over  a 
range  of  reliabilities.  The  most  logical  choice  under  a  Bayesian  scheme  are 
the  posterior  risks,  which  may  be  interpreted  in  the  following  way.  The 
producer's  risk  is  the  probability  that  a  rejected  system  will  have  "high" 
reliability  and  th-2  consumer's  risk  is  the  probability  that  an  accepted  system 
will  have  "low"  reliability.  "High"  and  "low"  are  defined  by  the  thresholds 
ra  and  r^,  respectively.  This  report  uses  posterior  risks  for  both  producer 
and  consumer.  The  risk  pair  labelled  "other”  has  been  studied  in  reference 
3  and  found  to  have  poor  convergence  properties  in  terms  of  finding 
(Nj,  M)  solutions.  For  an  excellent  interpretation  of  all  these  risks,  refer 
to  Reference  2  .  The  definition  of  variables  in  this  problem  is  now 


complete,  as  shown  in 

Table  2. 

Producers 

Consumers 

Risk  a 

Risk  3 

1. 

Classical  Risks 

P( reject |r  -  ra) 

P(accept| r  -  r^) 

2. 

Average  Risks 

P(reject|r  >  r^) 

P(accept|  r  _<  r  g) 

3. 

Posterior  Risks 

P(r  >  rjreject) 

P(r  £  rg|accept) 

4. 

Other 

P(reject) 

P(r  £  r^laccept) 

Table  1:  Risk  Definitions 


Variable 


Definition 


Given  or  To  be  Calculated 


Nj  Number  of  Trials  In  Prior  Test 

Number  of  Failures  In  Prior  Test 

N2  Number  of  Trials  in  New  Test  To 

k2  Number  of  Failures  In  New  Test 

M  Maximum  Number  of  Failures  Allowed  To 

in  New  Test  for  an  Accept  Decision 

a  Producer's  Posterior  Risk,  To 

P(r  >  ra | Reject) 

6  Consumer's  Posterior  Risk,  To 

P(r  <_  Tg | Accept) 

a  Maximum  Tolerable  Value  For 

m 

Producer's  Posterior  Risk 

0  Maximum  Tolerable  Value  For 

IB 

Consumer' 8  Posterior  Risk 

ra  Reliability  Threshold  For  a 

Calculation 

Tg  Reliability  Threshold  For  0 

Calculation 


Given 

Given 

be  Calculated 

be  Calculated 

be  Calculated 

be  Calculated 

Given 

Given 

Given 

Given 


Table  2s  Variable  Definition 


J 


SECTION  4 

DEVELOPMENT  OE  THE  PRIOR  DENSITY  FUNCTION 

In  this  section  the  prior  probability  density  function  (pdf)  of 
reliability  is  developed.  This  prior  pdf  will  summarize  our  knowledge  of 
reliability  after  the  event  (N^ ,  k^)  but  before  the  event  (N^,  k2>.  Thus  our 
prior  pdf  will  be  based  upon  the  objective  test  data:  trials  and  kj 

failures. 

Before  the  event  (N^ ,  k^)  has  occurred,  assume  a  uniform  pdf  on  the 
random  variable  r,  true  reliability.  We  are  saying  that  all  values  of  r  are 
equally  likely  in  the  absence  of  any  other  information.  Thus 

(1,  0  <  r  <  1 

“  “  (1) 

0,  otherwise 

Conduct  an  experiment:  N^  bernoulli  trials  resulting  in  k^  failures.  Denote 
this  experimental  result  by  Ej .  The  pdf  of  r,  given  this  test  data,  follows 
from  Bayes  Theorem 

P(E  |r)f(r) 

,(tlV  — «> 

where  f(r)  comes  directly  from  (1),  P(E^ jr)  is  a  simple  binomial  pdf,  and 
P(Ej)  comes  from  the  law  of  total  probability: 

,1 

P(B.)  -  /  P(E. |r)f(r)dr.  (3) 

1  o  1 
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We  have 


N.  ! 


P(Ej) 


"j  . 

^  kjKNj  -  kj)!  r 

V 

kj !  (Nj  -  kx)! 


Nj  -  k  k^ 

1  1  (1  -  r)  1  •  1  •  dr 


1  Ni  “  kt  ki 

/  r  1  1  (1  -  r)  1 


dr 


The  integral  nay  be  recognized  as  the  beta  function,  giving  us 

Nl!  r  (N1  “  kl)!(kl)!  ”|  1 

"  kjTOl'j  -  kj)!  I  (Nj  +  1)!  J  "  Nj  +  1  * 


(4) 


Our  result  in  (4)  will  now  be  used  in  the  denominator  of  (2)  to  develop  our 
conditional  pdf  of  r. 


Therefore 


P(E. |r)f (r) 

f(r|Ei) - - 


V 


kjf^  -  kj )! 


k  N  -  k 
(1  -  r)  lr  1  1 


Nj  +  1 


(Nj  +  1)! 

kj  !  ('Nj  -  kj  >  f 


0  <  r  <  1 


(5) 


Clearly  (5)  is  the  pdf  of  true  reliability  r,  given  the  experimental  result  Ej. 
As  the  new  test  (N^,  k,,  _<  M)  is  designed,  then,  we  will  use  (5)  as  the  prior 
pdf.  To  simplify  the  notation  we  will  simply  use  f(r)  to  denote  this  new  prior 
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density  function.  Equation  (S)  aay  be  recognised  as  a  beta  pdf  with  the 
following  characterizations: 


E(r) 


Nj  -  kj  +  1 

“  V"  2 


;  aode 


Var(r) 


(Nj  -  kj  +  lXkj  +  1) 
(Nj  +  3)(Nj  +  2)2 


(6) 

(7) 


to  summarize  this  section,  the  user  with  test  data  (N^ ,  )  now  has  the 

pdf  of  reliability  and  its  wan  and  variance.  Probability  statements  about 
the  random  variable  r  readily  follow  by  integrating  (5)  over  some  interval  of 
reliability  values. 

It  is  interesting  to  note  that  (5)  may  be  used  to  generate  classical 
confidence  intervals  on  the  proportion,  r.  Suppose  a  test  consists  of  N* 
trials  and  k*  failures.  To  construct  classical  lower  confidence  limits 
(a  percentile)  on  r,  let  »  B*  -  I  and  kj  -  k*  in  (5)  and  compute  the  a 
percentile  of  f(r).  We  are  gaining  a  "degree  of  freedom"  in  the  Bayesian 
approach  (N*  ■  Nj  +  1)  by  originally  assuming  the  uniform  prior  pdf  on  r.  To 
construct  classical  upper  confidence  limits  (1  -  a  percentile)  on  r,  let 
Nj  ■  N*  -  1  and  kj  *  k*  -  1  in  (5)  and  compute  the  1  -  a  percentile  of  f(r). 
In  finding  the  percentiles  of  (5)  it  is  useful  to  note  that 


(N1  +  l)! 
k1!(N1  -  kj)! 


k  N 
(1  -  r)  r  1 


is  equivalent  to 


k  H  +  1  -  I 

*1  (N,  +  l)fro  (1  -  r/ 

l  TlfM  +1-1)1 
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SECTION  5 


DEVELOPMENT  OF  PRODUCER’S  RISK 
a  -  P(r  >  ra|Reject) 

Producer's  posterior  risk  may  be  interpreted  as  the  proportion  of 
rejected  systems  with  reliability  above  some  threshold  (ra).  Me  begin 
with  the  definition 

a  -  P(r  _>  ralReJect) 

L 

-  /  f(r|Reject)dr.  (8) 


Now  Bayes'  Theorem  will  be  applied  to  find  the  Integrand  of  (8)  as  follows: 


The  terms  in  the  numerator  of  (9)  pose  no  problems:  f(r)  is  the  prior  pdf  (5) 
based  on  the  test  data  (N^ ,  k^);  and  P(Reject|r)  is  the  probability  of  more 
than  M  failures  out  of  N^  trials  in  the  new  test.  This  latter  term  may  be 
found  using  the  binomial  pdf 
P(Reject| r)  -  P(k2  >  M|r) 


"2 

I 

k.-M+l 


1 


^  . 

r 

t 


■  Jyr-’-.r-J- 


The  denominator  of  (9)  may  be  found  using  the  law  of  total  probability: 
1 

P(Reject)  -  /  P(Reject|r)f(r)dr 
o 


rlr  M 


V 

k2!<N2  -  k2)!  r 


N2"k2  k2l  (NI  +  1)!  Nl-kl 

2  Z(l  -  r)  2  L  i,'--  ,,  r  1  -  r)  Xdr 


n  vni  +  -  ‘i, 

ki!(Ni  ■  ki>!  r 


n  +  1)!  . 

kLo  k2lk!!^N2  "  k2)!(Ni  “  ki^!  l 


N,  +  N.  -  k.  -  k„  k  +  k_ 

1  1  ^(1  -  r)  1  1  dr 


N2!(Nj  +  1)! 


M 

k«»0  k2!ki,(N2  "  k2)!(Ni  '  ki)! 


(Hj  +  N2  -  kt  -  k2)f(k1  +  k2)! 

Tn^TnJTTTI 


NJ(H,  +  1)! 


M  (N,  +  N„  -  k,  -  k0)!(k,  +  k2)! 


.  21  y  1  2  1  2  1 

“  '  kj ! -  kjVl  (Nj  +  N2  +  1>!  k2!(N2  -  k2)! 


(11) 


We  now  have  each  of  the  three  terms  required  for  equation  (9),  the  Integrand  of 

equation  (8).  Notice  that  the  integration  In  (8)  is  accomplished  with  respect  to 

the  variable  r,  which  does  not  appear  in  our  result  for  Pf Reject).  Because  of 

this,  we  can  integrate  the  numerator  of  (9)  and  then  divide  by  P(Reject).  For  the 

Integral  we  have 
1 

/  P(Reject|r)f(r)dr  - 


f T  ,  -  ?  V  *2  -  k2n  .  k2-j  (W1  +  1)!  N1  -  kl 

/  k2»0  V21<1*2  -  k2)!  r  r  kjJ(Nj  -  kj >!  r 
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iTafprTf’jr  - 


(N  +  1)!  N  -  k,  1  lc. 

k,!(Nj  -  k j ) !  /  r  (  lK-0  r  dr 


(Nj+Df  M 

Tnrzrrr  l 


1  1  1  k  -0  "'2* '"2  *2^  rJ 


f  Ml+N2-krk2  kl+k2  k.+k 

J  1  1  (K 


l  (  *i  2)(-l)IrIdr  (12 
1-0  1 


For  the  first  half  of  equation  (12)  we  proceed  as  follows: 


(N.  +1)!  *1  k,  «i  -  *i  t  X  T  1  -| 

i'<ni  -ki>'  iJ  *)H)  V-  s + 1  * 1  _  ■ 


N,  -  k,  +  I  +  1 


fc  N  -  k,  +  I  +  1 

(N  +1)!  ll  k.  _  (l  -  r  1  1  ) 

V(Nl  -  k^l  X^Q  (  I^-1^  Nj  “kj  +1+  1 


For  the  second  half  of  equation  (12)  we  proceed  In  a  similar  fashion: 


(Nj+1)!  M  N2! 

V'W  k^.0 


V  ^  ,k.*2u 


£  <  ,'N‘Virw^ 


(Nj+l)!  M  N2! 

V<W'  ^  k2»<«2-k2 


V  klf2k,4t2 


(1-r  Nl4W2"krk2+I+1) 

il  k  o  > 


"  Jo  ^  1  VVkrk2+I+1  ’  <l4) 


Now  we  have  all  the  terms  needed  for  a,  and  the  result  Is  shown  In  Figure  1. 
The  notation  (J)  ■  N! /[ x!(N-x) ! ]  has  been  used  for  brevity. 

To  summarise  this  section,  we  have  found  an  expression  for  the  producer's 
posterior  risk  (a)  as  a  function  of  ^ ,  kj,  ro,  N2  and  M.  Now  we  turn  to 
consumer's  posterior  risk. 


*■*■**■  v- 


I  Reject) 


SECTION  6 


DEVELOPMENT  OF  CONSUMER'S  RISK 
8  -  P(r  <  r^Accept) 

Consumer's  posterior  risk  may  be  Interpreted  as  the  proportion  of 
accepted  systems  with  reliability  below  some  threshold  (r^).  Once  again 
we  begin  with  the  definition 
8  -  P(r  £  r^Accept) 

r8 

*  /  f(r | Accept)dr 
o 

ra 

.  f  P(Accept[ r)f (r)  dr 

J  P(Accept) 

o 

,  r0 

"  P(  Accept*)  /  P(  Accept  I  r)f  (r)dr  (15) 

o 

For  the  integral  in  (15)  we  have 


BM  N,  N  -  k.  k,  N,  N>-  k.  k. 

I  l  L2)  r  2  2(1  -r>  2(H  *  DC-1)  r  *.  ‘(1  -  r)  ‘dr 

o  k2«0  2  1  -1  \ 


N.  M  N,  r8  N,  +  N,  -  k,  -  k,  kl+k2  k.+k.  T  T 

(  1)  t  (  2w  _  1  2  1  2  r  r  1  ,iU 


n  •  ra  n.  K  « 

(«,  *  1111)  !  (t2)  /  r 


1  k2-0  2  o 


l  (  *  "K-OVdr 
1-0 


N,  M  N,  kl+k2  k,+k 


Ni  +  N2  -  ki  -  k2  +  1  +  ! 


N.  M  N,  1  2  k.+k,  t  ra 

•  <».  *  ‘>(k  l  >  1  (  lx  ‘M'O1  .vr.D.M 


1  k2-0  2  1-0 


1  ”2  1  2 


For  8  we  simply  divide  (16)  by  the  complement  of  P(Reject),  given  by  (11). 
The  results  are  shown  in  Figure  2. 

To  summarize  this  section,  we  now  have  an  expression  for  the  consumer's 
posterior  risk  (8)  as  a  function  of  Nj,  kp  r^,  N2,  and  M. 
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SECTION  7 


THE  SEARCH  FOR  (N2>  M)  SOLUTIONS 

Ac  this  point  we  have  expressions  for  a  and  8  as  functions  of  N^,  k^,  , 

M,  rQ,  and  r^.  He  can  plot  a  and  8  versus  N^  to  produce  the  families  of 

curves  as  shown  in  figures  3  through  6.  Each  curve  is  drawn  for  a  particular 

M,  as  labelled.  Analytically  our  problem  is  to  find  the  smallest  value  of  M, 

and  then  the  smallest  value  of  N2,  which  will  yield  values  of  a  and  b  below 

the  predetermined  thresholds  a  and  8  .  The  problem  is  summarised  in  Table  3 

Hi  m 

and  amounts  to  finding  the  inverse  functions  of  the  a  and  3  expressions  in 

terms  of  M  and  N2«  An  iterative  scheme  will  be  required. 

To  develop  an  algorithm  for  finding  (N2,  M)  solutions  we  note  from 

figures  3  through  6  that  a  is  an  increasing  function  of  N2  and  a  decreasing 

function  of  M,  while  3  is  a  decreasing  function  of  N2  and  an  increasing 

function  of  M.  We  will  begin  with  M  -  0  and  increase  N_  until  3  <  3  .  This 

A  IB 

assures  us  of  finding  the  fewest  additional  tests  ("shortest  test")  necessary  to 
satisfy  the  3  threshold.  At  this  point  (N2,  M)  we  will  check  to  see  if  o  <  a^, 

in  which  case  we  have  a  solution.  Otherwise  we  must  Increase  M  (to  reduce  the 

value  of  a)  and  start  over.  The  result  is  an  iterative  scheme  as  described  in 
Table  4. 

To  illustrate,  consider  the  example  where  past  data  consists  of  20  trials 

and  1  failure  and  we  have  r  -  .9,  r„  ■  .9  and  a-  8  -  .25.  (See  Figure  3). 

a  p  in  m 

Our  first  (N2»  M)  candidate  is  (6,  0)  but  this  gives  a  off  of  our  scale  (>  .30). 

Next  is  (11,  1)  with  a  ■  .30.  Incrementing  m  again  by  1,  we  try  (18,  2)  with 

o  -  .23.  Since  a  -  .23  <  a  ■  .25  the  pair  (18,  2)  is  the  "shortest  test" 

n 


solution 


J 


-s 


y*.  ; 
'V  •  .' 


Given:  Nj  trials 

kj  failures 

ra  and  r0 

a  and  0 
m  m 

Expression  for  a  (Figure  1) 
Expression  for  0  (Figure  2) 


Find:  The  smallest  M  and  then  the  smallest  N_ 


Such  that:  a  <  a 


0  <  0 


and 


Table  3:  Problem  Statement 

One  final  note  is  in  order.  The  possibility  exists  for  the  prior  test  data 

(N, ,  k.  )  to  be  so  "favorable"  with  respect  to  a  and  0  that  additional  testing 

m  m 

is  not  required.  To  identify  these  cases  we  realize  that  if  no  additional 
testing  is  to  be  performed  then  an  accept  decision  is  Implied.  Since 
a  «  P(r  >  r  /Reject)  we  have  a  -  0  necessarily.  Also,  since  0  -  P(r  <  r -/Accept) 

«  P 

we  have  0  -  P(r  <  r^).  Therefore,  the  cases  where  no  additional  testing  is 
required  are  those  which  satisfy  P(r  <  r^)  <  0^,  and  this  check  can  be  readily 
performed  using  the  results  of  Section  4  for  the  prior  pdf  of  r. 
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Appendix  A  is  a  listing  of  computer  programs  used  to  accomplish  this 
iterative  scheme.  The  programs  are  written  in  Basic  and  were  run  on  a  TRS  80 
Model  III  Computer.  The  results  are  tabled  in  Appendix  B. 

1.  Draw  a  horizontal  line  at  ?  ■  B  .  The  first  B  plot  intersected 

m 

(probably  M  -  0)  is  the  shortest  test  to  satisfy  0  <  3  . 

—  ID 

2.  Read  the  M2  value  for  this  test  off  the  abcissa.  We  now  have  a 
candidate  (M21  M)  solution. 

3.  Read  the  corresponding  a  value  for  this  (N, ,  M)  pair.  If  a  <  a  , 

z  —  in 

the  current  (Nj,  M)  is  adequate.  Otherwise  increase  m  by  1  and 
repeat  the  procedure.  Be  sure  to  keep  N2  M  in  all  cases. 

Table  4;  Iterative  Scheme 


-17- 


SECTION  8 


SUMMARY  AND  CONCLUSION 

Tables  ere  now  available  (Appendix  B)  for  Che  design  of  statistical  tests 

under  the  conditions  outlined  in  Table  3.  Each  table  is  constructed  for  a 

given  r  ,  rQ,  a  ,  8  and  for  a  variety  of  (N, ,  k  )  pairs.  Tabled  values  are 
ot  p  n  n  11 

the  minima  (N„ ,  M)  required  to  keep  a  <  a  and  8  <  8  .  Note  that  when  past 
L  ""  tn  —  ni 

test  data  (N^ ,  kj)  are  favorable  with  respect  to  the  reliability  thresholds  ra 
and  r^,  economies  in  sample  size  N2  over  classical  tests  result.  It  is  noted, 
however,  that  "favorable”  is  somewhat  difficult  to  define.  If  past  data 
(Np  k,  )  are  not  favorable  then  corrective  action  is  in  order  and  Bayesian  tests 
may  not  be  appropriate.  In  these  cases  classical  tests  should  be  applied  after 
implementation  of  corrective  action. 
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appendix  a 


COMPUTER  PROGRAMS 


*90  Dfct-  INI  JL~N 

500  RE(*1 - 

510  REM 
520  REM 

530  GOSUB  lOOO 
540  GGSUB  13000 
550  FOR  K— 1  TO  31 
560  N1=JN(K) 

570  FOR  K1=0  TO  7 

580  IF  K 1 >N 1  THEN  GOTO  640 

590  IF  NIC 4  THEN  GOTO  605 

600  IF  K1X.8*N1>  THEN  GOTO  640 

605  GOTO  15000 

610  GOSUB  10000 

620  GOSUB  11000 

630  GOSUB  12000 

640  NEXT  K1 

650  NEXT  K 

660  CLOSE 


EXECUTIVE  RRQuriNE 
’  1N1T 

’ inpu rs 


CHECK  FOR  RIRCRBX  BETA  MAX 
' (N2, M)  SOLUriON 
’SCREEN  PRINT 
’DISK  PRINT 


670  END 

1000  REM - 

1010  REM  INITIALIZE 

1020  REM 

1050  DIM  I C ( 50 )  ,  J  N  ( 50 ) 

1060  FOR  1*1  TO  20 
1070  JN(I)*I 
1080  NEXT  I 
1090  FOR  1=  21  TO  31 
1100  READ  JN  < I ) 

1110  NEXT  1 

1120  DATA  25,30,35,40,45,50,60,70,60, 90, 100 
1130  REM  SET  UP  INTEGER  COEFFS 

1140  REM  FOR  SIMPSONS  RULE 

1150  REM 

1155  ND=20  ’  NUMBER  OF  SUBDIVISIONS  (EVEN) 

1160  IC  <0) *1 
1170  I C ( ND ) = 1 
1180  FF=2 

1190  FOR  1*1  TO  (ND— 1 ) 

1200  FF=6-FF 
1210  1C(I)*FF 
1220  NEXT  1 
1230  RETURN 

2000  REM - 

2010  REM  SET  UP  FOR  SIMPSONS  RULE 

2020  REM 

2030  Z*5  ’NUMBER  OF  STANDARD  DEVIATIONS 

2050  RM=(N1— Kl+1) / (Nl+2)  ’MEAN  OF  BETA  PRIOR 

2060  RS=SOR( ( (Kl+1) * (Nl-Kl+l) ) t  ( (Nl+3) * (Nl+2) * (Nl+2) ) ) 

2070  RO=RM-Z*RS  'LOWER  LIMIT 

2080  IF  ROCO  THEN  R0=.00001 

2090  R9=RM+/*KS  ’UPPER  LIMIT 

2100  IF  R9>1  THEN  R9=. 99999 
2190  RETURN 

3000  REM - 

3010  REM  CALCULATE  F (R)  COEFFICIENT 

3020  REM 
3030  X 1* 1 

3040  FOR  I* (Nl— Kl+1 >  TO  (Nl+1) 

3050  Xl=Xltl 
3060  NEXT  I 


3070  FOR  1*1  TU  K1 
3080  Xl-Xl/1 
3090  NEXT  I 


J 


3100  RETURN 

4000  - - 

4010  REM  CALCULATE  F(R>  GIVEN  COEFFICIENT 

4020  REM 

4030  F=X1*RI (Nl-Kl ) * <1-R> LK1 
4U40  RETURN 

5000  REM - 

5010  REM  CALCULATE  P<ACC/R>  &  R (REJ/R) 

5020  REM 
5030  PA=RtN2 

5040  IF  M=0  THEN  GOTO  5100 

5050  P1=PA 

5060  FOR  1=1  TO  M 

5070  P1=P1* (N2-I+1) * (l-R) / (R*I ) 

5080  PA=PA+P1 
5090  NEXT  I 
5100  PR=1— PA 

5110  IF  PR<0  THEN  PR=OsPtt=l 
5120  IF  PR>1  THEN  PR=lsPA=0 
5130  RETURN 

6000  REM - 

6010  REM  APPLV  SIMPSONS  RULE  < BETA) 

6020  REM 

6030  FS=0 

6040  RD= ( RU-RL ) / ND 

6050  FOR  J=0  TO  ND 

6060  R=RL+J*RD 

6070  GOSUB  5000 

6080  GOSUB  4000 

6090  FS=FS+IC(J)*PA*F 

6100  NEXT  J 

6110  FS=FS*RD/3 

6120  RETURN 

7000  REM - 

7010  REM  CALCULATE  BETA 

702 0  REM 

7030  IF  RB<RL  THEN  B=0:G0T0  7090 
7040  RL=R0sRU=R9: GOSUB  6000 
7050  XDEN=FS 

7060  RL=ROsRU=RB: GOSUB  6000 
7070  XNUM=FS 

7075  IF  XDEN=0  THEN  B*=0:G0T0  7090 
7080  B=  XNUM / X DEN 
7082  IF  B>. 99  THEN  B=.99 
7090  RETURN 

8000  REM - 

8010  REM  APPLV  SIMPSONS  RULE  (ALPHA* 

8020  REM 

8030  FS=0 

8040  RD= (RU-RL) /ND 

8050  FOR  J*0  TO  ND 

8060  R=RL+J*RD 

8070  GUSUB  5000 

8080  GOSUB  4000 

8090  F S=F  S+ 1 C ( J ) #PR*F 

8100  NLXl  J 

8110  FS=FS*RD/3 

8120  RETURN 

9000  REM - 

9010  REM  CALCULATE  ALPHA 

9020  REM 

9030  IF  RA>RU  THEN  A-llGUTU  9090 
9040  RL=R0jRU»R9j GOSUB  8000 
9050  XDEN=FS 

9060  RL*RAl RU*R9l GOSUB  8000 
9070  XNUM-FS 


A 


! 


j 


90/5  IK  XDKN-O  'I  HEN  A=0: GU  TO  9090 
9080  A=XNUM/XDEN 
9090  RE  1  URN 

10000  REM - 

10010  REM  FIND  <N2.M)  SOLUTION 

1 0020  REM 

10030  GOSUB  2000  ’  1NIT  SIMPSONS  RULE 

10040  GOSUB  3000  ’F(R)  COEFF 

10050  M=0:N2=1 

10060  GOSUB  14000  ’GET  BETA  SOLUTION 

10100  GOSUB  9000  ’ALPHA 

10110  IF  A< AM  THEN  GOTO  10140 
10120  M=M+1 

10130  IF  M=N2  THEN  N2=N2+1 : GOTO  10060 
10135  GOTO  10060 
10140  RETURN 


11000 

REM - 

— 

— 

1 1010 

REM 

PRINT 

TO  SCREEN 

11020 

REM 

11030 

IF  IHK=*1  THEN 

GUI  0 

1 1 10U 

1 1040 

CLS 

1 1 050 

PRINT"  RA 

RB 

N1  K 1 

N2 

M 

A 

B" 

1 1060 

PRINT"  ■** 

*== 

=32  ass  = 

ss*=s 

== 

SSBS" 

11070 

A*=  "  . ## 

.  ## 

#*#  ## 

### 

•# 

.## 

.##" 

11080 

IHF=1 

1 1090 

POKE  16916,2 

11100 

PRINT  USING  A* 

J  RA, 

RB,N1,K1,N2,M, 

A,  B 

11110  RETURN 

12000  REM - 

12010  REM  DISK  PRINT 

12020  REM 

12030  IF  JPF=1  THEN  GOTO  12060 
12040  OPEN  "0",1,S* 

12050  PR I NT # 1 , RA ;  RB ; AM ; BM 
12060  PRINT#1,N1;K1;N2;M; Aq B 
12070  JPF=1 
12080  RETURN 

13000  REM - - - 

13010  REM  REQUEST  INPUTS 

13020  REM 
13030  C;l_S 

13040  INPUT" INPUT  R  ALPHA  AND  R  BETA  =  " ; RA, RB 
13050  PRINT 

13060  INPUT" INPUT  ALPHA  MAX  AND  BETA  MAX  =  " ; AM, BM 
13070  PRINT 

13080  INPUT" INPUT  NAME  OF  DATA  KILE  " ; S* 

13090  S*=S*+":1" 

13100  RETURN 

14000  REM - 

14010  REM  FIND  SMALLEST  N2  FOR  B<  B  MAX 

14020  REM 

14040  GOSUB  7000 

14050  BH*BjNL=»N2 

14060  IF  BH< BM  THEN  GO TU  14210 

14070  N2*25 

14080  GOSUB  7000 

14090  BL=BsNH=N2 

14100  IF  BL<BM  THEN  GOTU  14130 

14105  BH=BL«NL»N2 

14110  N2-N2+25 

14120  GOTO  14080 

14130  NN* INI <NL+  <NH-NL>  4  <BM-BH> / (BL-BH) +.5) 

14135  IF  NN-N8  THEN  GOTO  14200 
14140  N2*NN 
14150  GOSUB  7000 


14185  N8=NN 

141  VO  GOTO  .14130 

14200  IF  b<BM  THEN  GOTO  14210 

14205  N2=N2+ 1 :  GUSUB  7o0o 

14206  GOTU  14200 
14210  RETURN 

15000  REM - 

15010  REM  CHECK  FDR  P  <R<RB1<BETA  MAX 

15020  REM 

15030  ri=RB£ (Nl+1 ) 

15040  CDF=T 1 

15050  IF  K1=0  T  HEN  GDI  0  15110 
15060  FOR  1=1  ID  K1 
15070  T 2=7 1  *  < 1— RED  $ (N1+2-I > / (RB*1 > 

15080  CDF=CDF+T2 
15090  T1=T2 

15100  next  I 

15110  IF  CDF>BM  THEN  GOTO  610 
1 5 1 20  A=0 : B=CDF: N2=0 : M=0 
15130  GOTO  620 


RESUME 


APPENDIX  B 

TABLES  FOR  BAYESIAN  RELIABILITY  TEST  PLANS 

\ 


BAYES  X  RELIABILITY  TEST  F>L_<=%»MS 


FOR 


R  ALPHA  =  .  7  R  BETA  =  . 7  ALPHA  MAX  =  . 1  BETA  MAX  =  . 1 
(VALUES  SHOWN  ARE  NUMBER  OF  TRIALS.  MAXIMUM  NUMBER  OF  FAILURES) 


K.l  =  0 

K1  =  1 

K1  =  2 

K1  =3 

1! 

K1  =  5 

>0 

li 

v 

K1  =7 

N1 

1: 

25/  7 

10/  0 

N1 

= 

2: 

32/10 

25/  5 

14/  0 

N1 

as 

3: 

26/  9 

46/12 

13/  0 

17/  0 

N1 

= 

4s 

23/  9 

56/16 

32/  6 

16/  0 

N1 

= 

5: 

12/  6 

63/19 

53/13 

15/  0 

19/  0 

N1 

S3 

6: 

0/  0 

60/19 

70/19 

27/  4 

18/  0 

N1 

= 

7s 

0/  0 

54/18 

87/25 

56/13 

17/  0 

21/  0 

N1 

as 

6: 

0/  0 

45/16 

94/28 

77/20 

16/  0 

20/  0 

24/  0 

N1 

as 

9s 

0/  0 

36/14 

91/28 

101/28 

45/  9 

19/  0 

23/  0 

27/  0 

N1 

= 

10s 

0/  0 

21/10 

88/28 

115/33 

77/19 

18/  0 

22/  0 

26/  0 

N1 

s 

Us 

0/  0 

0/  0 

82/27 

125/37 

101/27 

34/  5 

21/  0 

25/  0 

N1 

as 

12s 

0/  0 

0/  0 

70/24 

125/38 

122/34 

70/16 

20/  0 

24/  0 

N1 

= 

13s 

0/  0 

0/  0 

57/21 

129/40 

139/40 

98/25 

19/  0 

23/  0 

N1 

= 

14s 

0/  0 

O/  0 

50/20 

116/37 

156/46 

122/33 

56/11 

22/  0 

N1 

as 

15s 

0/  0 

0/  0 

0/  0 

107/35 

156/47 

146/41 

91/22 

21/  0 

N1 

= 

16s 

0/  0 

O/  0 

0/  0 

91/31 

160/49 

170/49 

1 19/31 

34/  4 

N1 

as 

17s 

0/  0 

0/  0 

0/  0 

73/26 

154/48 

180/53 

150/41 

73/16 

N 1 

= 

18: 

0/  0 

0/  0 

0/  0 

54/21 

141/45 

187/56 

174/49 

105/26 

N1 

- 

19s 

0/  0 

0/  0 

0/  0 

27/13 

132/43 

191/58 

191/55 

1 40/37 

N1 

20s 

0/  0 

0/  0 

0/  0 

0/  0 

113/38 

188/58 

201/59 

171/47 

N1 

= 

25  s 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

103/36 

190/60 

214/65 

N1 

as 

30  s 

O/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

101/37 

196/63 

N1 

as 

35  s 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

75/30 

N1 

= 

40  s 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

N1 

= 

45  s 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

N1 

as 

50  s 

0/  o 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

N1 

as 

60s 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0  /  0 

0/  0 

0/  0 

N1 

as 

70s 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

N1 

= 

80s 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 

0/  0 
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